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(54) PICTURE PROCESSING METHOD AND DIGITAL CAMERA MOUNTED WITH 
THE SAME AND ITS PROGRAM 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a method for designing an adaptive filter in 
order to improve the picture quality of a photographed picture. 
SOLUTION: This picture processing method is provided with a sharpness calculating 
means (102) for measuring the sharpness of an original picture with an SF value 
based on the distribution of difference values between a pixel under consideration and 
adjacent pixels at the time of deciding the parameter of a filter based on the 
sharpness of the original picture and a sharpness processing means (103) for deciding 
the coefficient of the filter based on the sharpness. 



CLAIMS 



[Claim(s)] 

[Claim 1]It is the method of changing the frequency characteristic of a picture by a 
digital filter which is different for every position of the picture in a pictureAn image 
processing method having sharp-ized down stream processing which measures 
sharpness of a source image with SF value based on distribution of a difference value 
of a noticed picture element and an adjacent pixeland determines a coefficient of a 
filter based on this when determining a parameter of a filter based on sharpness of a 
source image. 

[Claim 2]It is a digital camera which changes the frequency characteristic of a picture 
by a digital filter which is different for every position of the picture in a pictureA 



digital camera having a sharp-ized processing means to measure sharpness of a 
source image with SF value based on distribution of a difference value of a noticed 
picture element and an adjacent pixeland to determine a coefficient of a filter based 
on this when determining a parameter of a filter based on sharpness of a source 
image. 

[Claim 3]It is a program which changes the frequency characteristic of a picture by a 
digital filter which is different for every position of the picture in a pictureA program 
for making a computer perform processing which measures sharpness of a source 
image with SF value based on distribution of a difference value of a noticed picture 
element and an adjacent pixeland processing which determines a coefficient of a filter 
based on this measurement resultwhen determining a parameter of a filter based on 
sharpness of a source image. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to the image processing method which 
changes the frequency characteristic of a picture with a different parameter for 
especially every place of a picturethe digital camera which mounted itand a program 
with respect to the picture picturized with the digital camera etc. 
[0002] 

[Description of the Prior Art]In recent yearstwo-dimensional Image Processing 
Division by a digital filter has come to be widely performed by progress of LSI 
technology. This two-dimensional Image Processing Division includes low pass filter 
processinghighpass filter processingconvolution filter processingetc. The NxN 
individual centering on the pixel made into a processing object in this convolution 
filter processing (N is two or more.) The image data of the pixel made into the 
processing object is formed by carrying out the multiplication of the predetermined 
weighting factor to the image data of an integral pixelrespectivelyand adding these 
multiplication results. 

[0003]What is called an adaptive (adaptive) filter that performs filtering which is 
different in a moving image area and the Still Picture Sub-Division fieldfor example is 
also realizable by a digital filter. Howeversince low pass filter processing and highpass 
filter processing are what is uniformly given to the whole picture made into a 
processing objectthere is inconvenience which cannot use effectively the local 
information which an original image has. 

[0004]Speaking concretelyfor examplelosing important edge informationwhen a low 
pass filter is givenalso in the field where a luminance change is originally 
smoothemphasizing a noise etc. and being rough and visiblewhen a highpass filter is 



given. In the conventional simple convolution filter processingthere is inconvenience 
which cannot respond to various Image Processing Divisionsuch as nonlinear 
processingeasily. 

[0005]In view of such a problemthe method which separates a dynamic body and a 
background by a motion vector is indicated by JPH4-205573A. however — there is a 
limit also in the adaptation range of the adaptation filter which changes with positions 
only for such information on a motion — for examplea space peculiar to separation of 
the major object and background of a motion which are not almostand a curvature of 
field optical system — it is inapplicable to amendment of a variant Japanese quince. 
[0006]When it is going to design a digital filter according to the characteristic of an 
optical systemPSF (Point Spread Function) of an optical system is experimentally 
obtained by calculation in the stage of an optical designand a filter is designed in a 
form which complements the characteristic. 

[0007]usually — as the aberration of an optical system separates from on an optic 
axis — rotation — since an unsymmetrical ingredient (a coma aberration — 
astigmatic) becomes largeif the rotation asymmetry of PSF is taken into consideration 
in an ideal inverse filter — rotation — it becomes an unsymmetrical digital filter. But 
having data with a different parameter for every place of a picture as mentioned 
aboveif it will be called rotation asymmetry must have data of N x N for every 
pixeland it can be said to be unreal. By recovery of a frequency componentan effect 
is expectable also only by designing an inverse filter for the purpose of [ of imaging 
equipment ] anticipated use in the range which can consider that PSF is the 
symmetry of revolution. 

[0008]How to define a digital filter parametric has some typesand the filter H of high 
frequency emphasis is set up as follows in the example in the frequency recovery 
filter of the kernel size of 3x3. [Equation 1] 



The parametric recovery filter which adjusted the distribution coefficient of H with 
the parameter alpha is H 0 =alphal+(1 -alpha) H (2). 

1= identity matrix — hereif alpha is changedthe characteristic of a recovery filter can 
be adjustedand it will become a filter of high frequency emphasisso that alpha is small. 
[0009]Nexthow to calculate the inverse filter is described. It is exp (~d*R) about PSF. 
An effect can be expected even when approximated with an attenuation function as 
shown in (R expresses the distance from the pixel of the center made into a 
processing object). Beforehandthe filter of a least square error when changing d is 
calculated. 

[0010]The example computation of a least square filter is shown below. The target 
response function is made into ** function in the following examples. Field[Equation 
2] 



A coefficient matrix when the Japanese quince function come out of and defined is h 
(ij) and a linear filter expresses this[Equation 3] 

It becomes. Z-transformation expression of the transfer function of PSF to an 
impulse[Equation 4] 

It becomes. The FIR inverse filter to design[Equation 5] 

The definition is given. The thing which made the inverse filter act on PSF 
now[Equation 6] 

It carries out. The filter f is called for as follows from approximation of a least square 
error[Equation 7] 

****** It will become Ax=B if (14) types made into P=Q=m are expressed with matrix 
representationsince it is easy here. Contents which are x and B here [Equation 8] 

It shall have a **(2m+1) =4m 2 +4m+1 piece element (2m+1) which is said. 
[001 1]Hereif it has a coefficient of inverse filter f symmetrical with rotation by the 
look-up table when d is obtained as a parameterit will become the filtering processing 
which changes with positions of a picturewithout being based on the size of a picture. 
[001 2] As the other sharp-ized techniquesthe difference of an original image and the 
picture which gave the low pass is takenand there is a method of adding the fixed 
multiple of difference to an original image. The constant at this time is given as a 
parameter. 

[0013]The situation of needing a filter which changes with image positions can 
consider the following. Like the latest digital camerawith the small digital camerait is 
especially made difficult to express the "dotage taste" so that the tendency for the 
depth of focus to be shallow and for depth of field to be deep may appearas the size 
of an acceptance surface becomes small. Thenthe accommodative method that the 
filter which improves a frequency response is designed from the information on the 
contrast of the photoed picture is needed. 

[0014]About the space invariantthe Japanese quince state of a picture is measured 
accommodative and the art of hanging an inverse filter on the defocusing state of a 



picture accommodative as a method of hanging an inverse filter at JPH6-162187A is 
indicated. As a Method of amendment depending on a picturein JPH1 1 -1 50669A. It 
uses that the structure of the photographic subject is self-similar figures (for 
examplea branchthe picture of ****)and the frequency spectrum structure of the 
picture of the high resolution made into the frequency spectrum structure of the 
picture of low resolving and an ideal turns into a similar structure by a frequency shift. 
[0015] 

[Problem(s) to be Solved by the Invention]Howeveralthough an inverse filter is hung 
on the defocusing state of a picture accommodative in JPH6-162187ASUBJECT that 
need the two or more image surfaces at the time of measurementand special 
composition is needed for a photographing instrument occurs. Although Methods of 
amendment depending on a picture include JPH1 1~150669AThis uses that the 
structure of the photographic subject is self-similar figures (for examplea branchthe 
picture of ****)and the frequency spectrum structure of the picture of the high 
resolution made into the frequency spectrum structure of the picture of low resolving 
and an ideal turns into a similar structure by a frequency shift-Although excelled as an 
accommodative Method of amendmentit is difficulties that cost starts calculation and 
that the kind of picture which can be adapted will be limited. It aims at arranging a 
feeling of resolving to the picture from which a feeling of resolving differs by the 
position of an image like a curvature of fieldor emphasizing the dotage taste by 
distance conversely. 

[0016]the purpose of this invention — above — a space — by variant filteringwhen 
trying to perform improvement of image qualityand processingthe method of 
calculating the coefficient of a filter is provided. In detailin the inverse filter of a 
simple structure like the symmetry of revolutionthe coefficient of the inverse filter is 
related with the parameter of the dotage condition of PSFand the method of 
determining the parameter is provided. It is the picture which separated the field and 
is providing the image processing method which adjusts the dotage taste of each field 
and processes depth of field in falsethe digital camera which mounted itand a 
programing method. 
[0017] 

[Means for Solving the Problem]An image processing method by this inventiona digital 
camera which mounted itand a programlt is the method of changing the frequency 
characteristic of a picture by a digital filter which is different for every position of the 
picture in a pictureWhen determining a parameter of a filter based on sharpness of a 
source imageit is an image processing method provided with sharp-ized down stream 
processing which measures sharpness of a source image with SF value based on 
distribution of a difference value of a noticed picture element and an adjacent 
pixeland determines a coefficient of a filter based on this. 

[001 8]It is a digital camera which changes the frequency characteristic of a picture by 
a digital filter which is different for every position of the picture in a pictureWhen 



determining a parameter of a filter based on sharpness of a source imageit is a digital 
camera provided with a sharp-ized processing means to measure sharpness of a 
source image with SF value based on distribution of a difference value of a noticed 
picture element and an adjacent pixeland to determine a coefficient of a filter based 
on this. 

[001 9]It is a program which changes the frequency characteristic of a picture by a 
digital filter which is different for every position of the picture in a pictureWhen 
determining a parameter of a filter based on sharpness of a source imageit is a 
program for making a computer perform processing which measures sharpness of a 
source image with SF value based on distribution of a difference value of a noticed 
picture element and an adjacent pixeland processing which determines a coefficient of 
a filter based on this measurement result. 
[0020] 

[Embodiment of the Inventionjln the method which is high frequency emphasis or low 
frequency wave emphasisand adjusts the sharpness of a pictureand the dotage taste 
by a digital filterthis invention relates to the method of adjusting the parameter of 
said digital filter. 

[0021 ]The embodiment of this invention is used for belowDrawings are used for 
belowand it explains. 

[0022]First drawing 1 is a key map showing the frequency characteristic compensation 
means of the embodiment of this invention. This embodiment is the method (sharp- 
izingshading off) of changing the frequency characteristic of a picture by a digital filter 
which is different for every position of the picture in a pictureand determines the 
parameter of a filter first based on the sharpness of a source image. In that caseit is 
SF (Sharpness Factory) value based on distribution (delta histogram) of difference 
value **D of a noticed picture element and an adjacent pixel which the method of 
measuring the sharpness of a source image showed to drawing 2 and it determines the 
coefficient of a filter based on this. When supplemented about ** D value and SF 
value herethe difference value of an adjacent pixellf it is a difference absolute value 
of the luminosity of a noticed picture element and the pixel of the eight contiguityfor 
examplea central pixel level is set to 16 and the surroundings of it have become 
121 4208241 21 6and 32 as shown in drawing 3 As the absolute value of difference is 
shown in drawing 4 it is set to 4248840and 16and the histogram (frequency of 
occurrence of **D of 0-16) of **D is set to (10103000200000001). Such a histogram 
is integrated about the pixel of the predetermined range. The histogram of above- 
mentioned difference **D (absolute value) in an original image is made into S 0 (I)what 
covered the smoothing filter over the original image is made into S 3 (I)and it is 
sharpness SF. [Equation 9] 



** — a definition is given like. It becomes the evaluation said that sharpness of an 



original image is highso that SF value is large. 

[0023]Nexta delta histogram of an original image and a picture which gave an average 
filter was shown in drawing 5 . SF value integrates with an absolute value of difference 
of two histograms. Since SF value is a value depending on a picture so that a 
definition may showgenerally a strict relation with a frequency component of a picture 
is not realized. Howeverto picture same as a general trendif SF value is highit can be 
said that a frequency characteristic is extended to high frequency. 
[0024]With [ if it is the picture which information on a photographic subject does not 
differ but has a large frequency component by the position of a picture like a random 
pattern ] such conditionsit can evaluate that fade by the position of a picture and 
condition differs by aberration (a curvature of fielda spherical aberration) of an optical 
systemetc. In usualsince near the optic axis is designed as MTF is most extended to 
a high frequency componentby comparing SF value near an axis top with SF value 
besides an axis shows how much sharp-izing is required. 

[0025]Nextit returns to drawing l and firstan inputted image is inputted from the image 
input means 100and data is passed to the frequency characteristic compensation 
means 101. Herethe frequency characteristic compensation means 101 consists of 
the sharpness calculating means 102the filter-parameters calculating means 103and 
the digital filter 104and a picture which gave a digital filter is outputted as an 
outputted image. Said sharpness calculating means 102 calculates SF value 
mentioned above. And the filter-parameters calculating means 103 shows LUT (Look 
UpTable) which shows SF value and a relation of filter parametersand a calculating 
means which defined an expression of relations so that it may mention later. This LUT 
may be a parameter of a parametric filteras SF value and a relation of each 
calculation of a procession which constitutes a digital filter may be expressed and 
being mentioned above or mentioned later. 

[0026]As an example of a digital filterthe filter H of high frequency emphasis is set up 
as follows with a frequency recovery filter of kernel size of 3x3 as mentioned above 
parametric. 
[0027] 

[Equation 10] 

The parametric recovery filter which adjusted the distribution coefficient of H with 
the parameter alpha can adjust the characteristic of a recovery filterif the 
H 0 =alphal+(1 -alpha) HI= identity matrix alpha is changedand it turns into a filter of 
high frequency emphasisso that alpha is small. 

[0028]ln order to presume the value of alpha herehow to use above-mentioned SF 
value is described. With [ if it is the picture which the information on a photographic 
subject does not differ but has a large frequency component by the position of a 
picture like a random pattern ] such conditionsit can evaluate that fade by the 



position of a picture and condition differs by the aberration (a curvature of fielda 
spherical aberration) of an optical systemetc. In usualsince near the optic axis is 
designed as MTF is most extended to the high frequency componentby comparing SF 
value near an axis top with SF value besides an axis shows how much sharp-izing is 
required. 

[0029]Nextas shown in drawing 6f irstthe random pattern 601 is photoed and digital 
data is obtained. The digital image data 604 which included the transfer characteristic 
of the imager 603 which are the optical system 602 and an imaging system at this 
time is obtained. 

[0030]According to said optical system 602the characteristic of a sampling of an 
imagerthe characteristic of an AD translationand the other characteristics of an 
electric system are contained by optical propagation characteristic (mainly amplitude : 
MTF) and said imaging system (imager 603). With said digital image data 604a delta 
histogram is calculatedrespectively in the field C of near [ A ] the center of a 
picturenear [ 1/2 / B ] image heightand the image height 1 neighborhoodand SF value 
is obtained. HereSF value of a field of the fields B and C is brought close to SF value 
of the field A. The calculation method is explained using drawing 7 . 
[0031] An initial value of alpha of the formula 12 and the decrement width delta are 
set up using a picture (S701) of a field of B and C (S702). 

[0032]Nextfiltering is performed to a field of B or C (S703). Filtering takes a margin 
for calculation of a delta histogram. And according to a definition of the above- 
mentioned formula lOcalculated SF value calculates SF value of the field A used as a 
standard from a field of B or C which carried out filtering (S704S705). 
[0033]And it is judged [ SF value of the field A used as a standardand ] whether it is 
near. At this timeit may judge in binary simply and a gradual judgment may be made. If 
a judging standard is metan end (S707) and the parameter alpha will be acquired for 
processing. When the standard is not being metthe parameter alpha is changed by 
S708. At drawing 7 although a change of a parameter is made by a decrement at equal 
intervalsa method of changing decrement width accommodative may be usedand in 
order to improve convergence accuracyit may investigate in round trip around the 
optimal solution. 

[0034]Thusin order to bring a frequency characteristic besides an axis close to a 
thing on an axisa field is discretely sampled with ABand Ca parameter of each field 
acquires with SF valueand then it asks for a parameter between each field with 
interpolation. There does not need to be any field to sample by such three pointsand 
many fields may be set up in order to raise accuracy. 

[0035]Thusif image height of the image surface and a relation of the parameter alpha 
are obtainedit will be memorized as an LUT and filtering which changes in the 
direction of image height will be realized. A method of calculating the optimal inverse 
filter with the least square method is used for a method of designing another 
parametric filter using an above-mentioned Exp function. It is the secondary function 



about a Japanese quince function. [Equation 11] 



Suppose (E expresses the size of a Japanese quince function). Herei and j express 
the index when the center position of the Japanese quince function for an axis is set 
to (00). The coefficient of an inverse filter is calculated from change of the parameter 
d. If d is smalla Japanese quince will be large and high frequency emphasis of an 
inverse filter will also become large. In order to suppress the error in a high frequency 
regionit is good as for a thing which made the high frequency band ease without 
making the objective function for an inverse filter into a delta function. 
[0036]The number of elements for which it should ask in consideration of symmetry 
here since a filter of 7x7 is shownlt becomes ten sorts {F (-3-3)F (~3-2)F (-3-1 )F (- 
3-0)F (-2-2)F (-2-DF (-2-0)F (-1-1 )F (-1-0)F (00)}. 

[0037]Next* shows other elements of a procession to drawing 8 and the symmetry of 
a procession to those fields are equal to one of ten sorts of above-mentioned 
elements. 

[0038]A value of each element when changing d from 0.3 to 5 is shown in drawing 9 . 
Thusit has an element of a procession by LUT to a value of d. 

[0039]Nexthow to carry out semi- to above-mentioned drawing 7 and compute a value 
of d from SF value is explained using drawing 10 . An initial value of d of the formula 
14 and the decrement width delta are set up using a picture of a field of B and C 
(S1001) (S1002). And an element of an inverse filter is read from a value of d by 
LUTand inverse filter H inv (d) is constituted (S1003). Thenfiltering is performed for an 
inverse filter in a field of B or C (S1004). And SF value calculated according to 
formula 10 above-mentioned definition calculates SF value of the field A used as a 
standard from a field of B or C which carried out filtering (S1005S1006). 
[0040]Nextit is judged [ a field and SF value of A used as a standardand ] whether it 
is near (S1007). At this timeit may judge in binary simply and a gradual judgment may 
be made. And if the standard is metprocessing will be ended (S1009) and the 
parameter alpha will be acquired. On the other handwhen the standard is not being 
metthe parameter d is changed by S1008. It can also interpolate and ask for a 
parameter as mentioned above. Interpolating in the direction of image height about a 
complement of this parameterand also interpolating according to a focal distance of 
an optical system and a diaphragm is also considered. For examplesupposing it places 
in quest of filter parameters in a field with a picture at f= 50 mm and f= 100 mmto f= 
70 mmit cannot calculate directlybut can ask with interpolation with reference to a 
value in the two above-mentioned focal distances. 

[0041]Nextcomposition of an image-quality-correction device which mounted in LUT 
filter parameters which were carried out in this wayand for which drawing 1 1 was 
asked is shown. A picture element position is computed by the address calculating 
means 1 1 2 to the inputted image 1 10and filter parameters are read from LUT 



according to a picture element position (1 1 3). this time — optic axessuch as a 
curvature of field — an object — a space — if it is variant amendmentdistance (image 
height) calculation is carried out from the center of a picture element position to an 
imagea parameter is read and a digital filter consists of LUTs (1 14). 
[0042]In LUTthe number of partitions of a position or the number of partitions of 
image height may be coarser than the number of partitions by a pixel. By interpolating 
filter parameters of LUTas linear interpolation expresses a position of a pixel made 
into an objectas shown in drawing 12 a digital filter consists of positions of a pixel then 
indicated to LUT. 

[0043]Nextposition information recorded on LUT123 is read in drawing 12 
(124)Address interpolation is performed (126)filter parameters recorded on LUT 
according to an interpolation coefficient are interpolated (125)the digital filter 127 is 
constitutedfiltering is performed to an inputted imageand a correction picture is 
outputted. 

[0044]As mentioned aboveaccording to a 1st embodiment of this inventiona filter 
which complements a frequency characteristic which changes in the direction of 
image height resulting from an optical system and an imaging system can be obtained 
using SF valueand a variable parameter can be obtained with interpolation by position 
of an imageand conditions of an optical system. After interpolating a RGB colorSF 
value is calculated from each color and it may be made to compute a filter of image 
quality correction by an above-mentioned method in a single plate Bayer array. 
[0045]Nexta 2nd embodiment of this invention is described. A 2nd embodiment of this 
invention is a compensation means of a picture provided with a compensation means 
of a frequency characteristic indicated to be distortion correction by optical system 
and an imaging systemand color shift amendment to a 1st embodimentand showed 
drawing 1 3 the composition. 

[0046]As shown in drawing 13 it is distortedand from a designed value of a lensthe 
compensation means 131 of a color shift obtains a value of a distortion aberrationand 
performs geometric conversion of a picture according to itand a correction picture is 
outputted via the frequency characteristic compensation means 132. An outline of a 
flow of processing at this time was shown in drawing 14 . A parameter of a filter is 
determined according to SF value which was distortedperformed a compensation 
process of a color shift to the inputted image 130 (S1 42)measured resolution using an 
image pick-up of an above-mentioned random pattern (SF value was used) (S143)and 
was measured as mentioned above (S144). computing filter parameters for SF value 
on an axis to reference using a random pattern as mentioned above — a space — a 
variant picture can be created and a recovery picture is outputted. 
[0047]lf an above-mentioned method is usedfrequency response nature by pixel 
interpolation used at the time of amendment of distortion at the time of determination 
of filter parameters will also be taken into consideration. In such a casefrequency 
response nature becomes fault amendment and it is possible aliasing and that an 



artifact comes out. Thereforeafter composition which makes turn of processing 
reverse like drawing 1 5 is also consideredperforming frequency characteristic 
amendment to the inputted image 150 first (151) and performing distortion correction 
(152)it is the method (153) of outputting an outputted image. 
[0048]as mentioned above — according to a 2nd embodiment of this invention — 
amendment of distortion and a space of an imaging system (lens) — a variant 
Japanese quince can be amended and degradation of a picture resulting from an 
imaging system can be amended. 

[0049]Nexta 3rd embodiment of this invention is described. 

[0050]l_ike a digital camera in recent yearswith a small digital camerait is especially 
made difficult to express a "dotage taste" so that a tendency for the depth of focus 
to be shallow and for depth of field to be deep may appearas size of an acceptance 
surface becomes small. Soin a 3rd embodiment of this inventionin order to expand 
Japanese quince condition which distance dependsa major object and a background 
are separated with edge detectionchroma saturationetc.SF value mentioned above in 
each field is calculatedthe frequency response characteristic of each field is 
distinguishedand filter parameters of each field are computed. 
[0051]Composition of a 3rd embodiment was shown in drawing 16 . 
[0052]Firsta picture is inputted into the image area separating mechanism 160 as 
shown in drawing 16 . In this image area separating mechanism 160an edge detection 
filter etc. detect a boundary of an image areaand a color in each boundarya frequency 
characteristica textureetc. separate an image areafor example. That isin a portion 
which a focus suits comparatively with a major objecta Japanese quince is contained 
and a thinga backgroundetc. that contrast is high are divided into what has low 
contrast. Each field fades through the following frequency correction means (161-1 - 
161-n)and condition is adjusted. (An adjustment method of Japanese quince condition 
was shown in following drawing 17 ). And an image which had a frequency 
characteristic amended is compounded (163)and a picture is outputted. 
[0053]Nextit faded to drawing 17 and an adjustment method of condition was shown. 
As shown in drawing 17 the SF value Sfi of the field i is calculated (S171)a value 
(threshold SFt) beforehand set to this result is read (S172)and size with this value is 
compared (S173). And when lower than said thresholdsharp-ized processing is not 
performed but processing of the field is ended, setting it as filter parameters of high 
frequency emphasis on the other handwhen larger than said threshold — sharp-izing 
— it processes (S174)and filtering (SI 75) is performed continuously. Thusexecution 
of sharp-izing is judged for every fieldit processes by predetermined filter 
parametersand deed processing is ended for composition of a picture by the field 
synthesizing means 162 of drawing 1 6 . 

[0054]Although this embodiment showed how for it to be [ field / where SF value is 
high ] further missing in high frequency emphasiswith thisa field where SF value is low 
is obscured further converselyor processing which lessens a difference of a Japanese 



quince conversely and makes depth of field deep in false can also be performed. 
[0055]Refer to a method using the above-mentioned random pattern for SF value and 
a relation of filter parameters. 

[0056]As mentioned aboveby using a 3rd embodiment of this inventionexceeding 
performance of depth of field which an imaging system hasit fades in false and a taste 
can be taken out. 

[0057]According to the above-mentioned embodiment of this inventioncomposition 
like the following is obtained. 

[0058]It is the method of changing the frequency characteristic of a picture by a 
digital filter which is different for every position of the picture in the "additional 
remark 1 " pictureAn image processing method having sharp-ized down stream 
processing which measures sharpness of a source image with SF value based on 
distribution of a difference value of a noticed picture element and an adjacent 
pixeland determines a coefficient of a filter based on this when determining a 
parameter of a filter based on sharpness of a source image. 

[0059] "Additional remark 2" When determining a coefficient of said filterlens design 
top MTF refers to SF value of the highest fieldAn image processing method given in 
the additional remark 1 determining that a parameter of a filter will bring SF value of a 
field which tries to recover sharpness close to SF value of a field where MTF is the 
highest on a lens design. 

[0060] "Additional remark 3" When determining a coefficient of said filterperform 
predetermined area division for a picture and sharpness is measured as an SF 
valueAn image processing method given in the additional remark 1 or 2 determining 
that a parameter of a filter will bring SF value of a field which tries to recover 
sharpness from this measurement with reference to a value of a field where SF value 
is the highest close to SF value of a field where sharpness is the highest. 
[0061]It is a digital camera which changes the frequency characteristic of a picture by 
a digital filter which is different for every position of the picture in the "additional 
remark 4" pictureA digital camera having a sharp-ized processing means to measure 
sharpness of a source image with SF value based on distribution of a difference value 
of a noticed picture element and an adjacent pixeland to determine a coefficient of a 
filter based on this when determining a parameter of a filter based on sharpness of a 
source image. 

[0062] "Additional remark 5" When determining a coefficient of said filterlens design 
top MTF refers to SF value of the highest fieldA digital camera given in the additional 
remark 4 determining that a parameter of a filter will bring SF value of a field which 
tries to recover sharpness close to SF value of a field where MTF is the highest on a 
lens design. 

[0063] "Additional remark 6" When determining a coefficient of said filterperform 
predetermined area division for a picture and sharpness is measured as an SF valueA 
digital camera given in the additional remark 4 or 5 provided with a sharp-ized 



processing means to determine that a parameter of a filter will bring SF value of a 
field which tries to recover sharpness from this measurement with reference to a 
value of a field where SF value is the highest close to SF value of a field where 
sharpness is the highest. 

[0064]"Additional remark 7" Sharpness of a source image is measured with SF value 
based on distribution of a difference value of said noticed picture element and an 
adjacent pixelA digital camera of any one description of the additional remark 4 
thru/or 6 provided with a mechanism in which a sharp-ized processing means to 
determine a coefficient of a filter based on this is a digital filterand the parameter is 
memorized. 

[0065]A digital camera of any one description of the additional remark 4 thru/or 7 
having further a mechanism in which interpolation from a memorized parameter 
determines a parameter of a digital filteraccording to the "additional remark 8" 
photographing condition. 

[0066]Distortion of the "additional remark 9" optical systeman image processing 
method of any one description of the additional remark 1 thru/or 3 having further a 
geometric conversion method which amends a color shift. 

[0067]"Additional remark 10" said sharp-ized processing means. [ whether the Ain 
Schaaf processing is performed to a field where SF value is lower than the specified 
quantityand ] Or an image processing method of any one description of the additional 
remark 1 thru/or 3 applying a low pass filterand processing to a field where SF value 
is high so that sharpness may go up. 

[0068]An image processing method given in the additional remark 10 using a delta 
histogram and self-organization MAFFU and dividing a field when a feeling of resolving 
of a picture of the "additional remark 11" origin divides a high field and a low field. 
[0069]An image processing method given in the additional remark 10 characterized by 
dividing a field with reference to a position on a color space of a delta histogram and 
a pixel when a feeling of resolving of a picture of the "additional remark 12" origin 
divides a high field and a low field. 

[0070]It is a program which changes the frequency characteristic of a picture by a 
digital filter which is different for every position of the picture in the "additional 
remark 13" pictureA program for making a computer perform processing which 
measures sharpness of a source image with SF value based on distribution of a 
difference value of a noticed picture element and an adjacent pixeland processing 
which determines a coefficient of a filter based on this measurement resultwhen 
determining a parameter of a filter based on sharpness of a source image. 
[0071] 

[Effect of the Invention]as mentioned above — separating the amendment (the 
spherical aberrationthe curvature of field)major objectand background of performance 
of an optical system by using this invention — a Japanese quince — a spacesuch as 
processing the taste— by variant filteringwhen trying to perform improvement of 



image qualityand processingthe method of calculating the coefficient of a filter can be 
provided. That isin the inverse filter of a simple structure like the symmetry of 
revolutionthe coefficient of the inverse filter is related with the parameter of the 
dotage condition of PSFand the method of determining the parameter is provided. By 
the picture which separated the fieldthe dotage taste of each field can be adjusted 
and the method of processing depth of field in false can be provided. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] The key map showing the frequency characteristic compensation means 
concerning a 1st embodiment of this invention. 

[Drawing 2] The figure showing SF value based on distribution of difference value **D 
of the noticed picture element and adjacent pixel concerning a 1st embodiment of this 
invention. 

[Drawing 3] The figure showing the noticed picture element concerning a 1st 
embodiment of this inventionand the pixel of the eight contiguity. 
[Drawing 4] The difference absolute value **** figure of the luminosity of the noticed 
picture element concerning a 1st embodiment of this inventionand the pixel of the 
eight contiguity. 

[Drawing 5] The figure showing the delta histogram of the original image concerning a 
1st embodiment of this inventionand the picture which gave the average filter. 
[Drawing 6] The figure showing digital data when the random pattern concerning a 1st 
embodiment of this invention is photoed. 

[Drawing 7] The figure showing a calculation method when bringing SF value of the 
field of the fields B and C concerning a 1st embodiment of this invention close to SF 
value of the field A. 

[Drawing 8] The figure showing other elements of the procession concerning a 1st 
embodiment of this invention by *. 

[Drawing 9] The figure showing the value of each element when changing d concerning 
a 1st embodiment of this invention from 0.3 to 5. 

[Drawing 10] The figure showing how to compute the value of d from SF value 
concerning a 1st embodiment of this invention. 

[Drawing 1 1] It is a figure showing the composition of the image-quality-correction 
device with which LUT mounted the filter parameters concerning a 1st embodiment of 
this invention. 

[Drawing 12] The figure showing the composition of the digital filter concerning a 1st 
embodiment of this invention. 

[Drawing 13] The figure showing the flow of processing of the correction picture 
concerning a 2nd embodiment of this invention. 



[Drawing 14] The figure showing the flow of processing of the correction picture 
concerning a 2nd embodiment of this invention. 

[Drawing 15] The figure showing the flow of processing when processing order of the 
correction picture concerning a 2nd embodiment of this invention is made reverse. 
[Drawing 16] The figure showing the composition concerning a 3rd embodiment of this 
invention. 

[Drawing 1 7] The figure showing the adjustment method of the Japanese quince 
condition concerning a 3rd embodiment of this invention. 
[Description of Notations] 

100 — An image input means 101 — A frequency characteristic compensation 
means102 — Sharpness calculating means103 — A filter-parameters calculating 
means 104 — Digital filterl 10 [ — Digital filter] — An inputted image 1 12 — An 
address calculating means123 — LUT127 130 [ — An inputted image160 / — Image 
area separating mechanism 162 / — A field synthesizing means601 / — A random 
pattern602 / — An optical system603 / — An imager604 / — Digital image data ] — 
An inputted image131 — A compensation means132 — A frequency characteristic 
compensation means! 50 
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